CHIRAYU: A Highly Available Metadata Server for Object Based Storage Cluster File System
نویسندگان
چکیده
The Lustre File System architecture supports Object Based Storage. It separates data and metadata path of file system operations. An outage of the Metadata Server could considerably degrade the system performance. Providing a backup Metadata Server will increase the availability of Lustre File System to 99.9%. The backup server monitors the primary server over the network and shared storage to detect failure. On failure of the primary server, the backup builds the state that was on the primary, and takes up its tasks. The first request from the clients triggers the recovery process on them. All further requests are queued till the completion of the recovery and clients thus receive non-blocking service from the server.
منابع مشابه
Ceph: A Scalable Object-Based Storage System
The data storage needs of large high-performance and general-purpose computing environments are generally best served by distributed storage systems. Traditional solutions, exemplified by NFS, provide a simple distributed storage system model, but cannot meet the demands of high-performance computing environments where a single server may become a bottleneck, nor do they scale well due to the n...
متن کاملLog-Less Metadata Management on Metadata Server for Parallel File Systems
This paper presents a novel metadata management mechanism on the metadata server (MDS) for parallel and distributed file systems. In this technique, the client file system backs up the sent metadata requests, which have been handled by the metadata server, so that the MDS does not need to log metadata changes to nonvolatile storage for achieving highly available metadata service, as well as bet...
متن کاملSymmetric Active/active Metadata Service for Highly Available Cluster Storage Systems
In a typical distributed storage system, metadata is stored and managed by dedicated metadata servers. One way to improve the availability of distributed storage systems is to deploy multiple metadata servers. Past research focused on the active/standby model, where each active server has at least one redundant idle backup. However, interruption of service and loss of service state may occur du...
متن کاملSnapshots in large-scale distributed file systems
Snapshots are present in many modern file systems, where they allow to create consistent on-line backups, to roll back corruptions or inadvertent changes of files, and to keep a record of changes to files and directories. While most previous work on file system snapshots refers to local file systems, modern trends like cloud and cluster computing have shifted the focus towards distributed stora...
متن کاملA Design of Metadata Server Cluster in Large Distributed Object-based Storage
In large distributed Object-based Storage Systems, the performance, availability and scalability of the Metadata Server (MDS) cluster are critical. Traditional MDS cluster suffers from frequent metadata access and metadata movement within the cluster. In this paper, we present a new method called Hashing Partition (HAP) for MDS cluster design to avoid these overheads. We also demonstrate a desi...
متن کامل